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SYSTEM AND METHOD FOR SIMULTANEOUSLY DISPLAYING 
VIDEO PROGRAMMING AND INSTANT MESSAGING 

BACKGROUND OF THE INVENTION 
[0001] instant messaging has become a popular forum for exchanging messages and 
information among computer users. Whi.e popu.ar, it has some drawbacks. For example the 
mstan. messaging screen useo for sending and receiving information typically .dentines the 
person posting any message next to his/her message, bu, it may no, reveal outer condttions 
pertaining to the message or its sender. For example, if the sender is engaged in a second 
activity (such as watching a TV program) at the same time as sending and receiving mstan. 
messages, tire recipient may no. know about the second activity unless .old by tire sender as 
part of the message. 

l00 021 Currently available instant messaging (IM) applications have outer characteristics 
that limit .heir use as a complele form of communications. For example, while may be 
possible u> initiate a voice conversation as part of me IM application, such vo.ee 
communications are implemented using a communication channel established by an IM 
server over me internet. Each user must have me proper software and hardware for 
participating in me voice communications. Such communications may no. use conventional 
telephones and the PSTN (public switched telephone network). 
[0003] Also, while it is known for people using email and instant messages t. send 
attachment wfth .heir messages, .here cart be prob.ems surrounding me attachments. For 
example, if me sender attaches a video clip of a TV program or movie, the recipient may or 
may no, be a subscriber ,o the service ( e.g., premium cable TV channel) ftom which me 
video clip was obtained. 
5 [0004] Further, wMle IM applications have the capability of collecting data concerning 
those sending and receiving messages, there has not existed a convenient manner of 
collecting that data and using it for purposes of understanding the habits or needs of users. 
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BRIEF SUMMARY OF THE INVENTION 
[0005] There is provided, in accordance with the present invention, a display system for use 
in a communications network, the display system having a display device, and plural display 
windows at the display device, the plural windows for simultaneously displaying multiple 
5 content to a viewer, wherein a first display window displays video programming content and 
wherein a second display window displays content from an instant messaging application. 
[0006] In another embodiment, the video programming content is a broadcast television 
program provided to the viewer over one of a plurality of selectable television channels and 
wherein the instant messaging content includes a program ID for identifying the broadcast 
10 television program being viewed by instant messaging (IM) users. 

[0007] In another embodiment, the instant messaging content further includes a selectable 
telephone communications element, and wherein a telephone communications line is 
established over the communications network between the viewer (the user at the display 
system) and a remote IM user having his or her personal ID displayed as part of the instant 
15 messaging content, when the telephone communications element is selected by the viewer. 
[0008] In yet another embodiment of the invention, the viewer is a subscriber to video 
programming content received over the communications network, the viewer is assigned one 
or more security keys in order to display the video programming content, an electronic 
message sent by the viewer to a remote IM user includes a video data file attachment 
20 obtained from the video programming content, the video data file includes a security key 
associated with the video programming content, and the video data file is displayed for the 
IM user only if that user has a security key matching the security key associated with the 
video programming content. 
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BRIEF DESCRIPTION OF THE DRAWINGS 
[0009] Fig. 1 is a simplified view of a network m accordance wim one embodiment of the 

present invention. 

[001 0] Fig. 2 illustrates a portion of the network seen in Fig. 1 . 

[0011] Fig. 3 is a block diagram illustrating the components of the set top box (STB) seen 
30 in Fig. 2. 
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.OOU, Figs. 4 through 6 flhtf*. various screen displays seen on a TV screen as part of an 
Ln. messaging (IM) application, and implementing one embodimen. of the tnvention 
,0013] Fig. 7 is a flow diagram illustrating a program proeess carried out within the STB 
seen in Fig. 3, in order for an IM user to make a telephone call to another IM user. 
,0014, Fig. 8 is a flow diagram illustrating a program process carried ou, within the STB 
for sending a video file from one IM user to another. 

,00X5, Fig, 9 and 10 illustrate functionality within me STB of an IM user for decrypting 

, 'a' o a v»v for use with a video file attachment that is to be 
video program signals, and provtding a key for use witn a v. 

sent to another IM user. 

, ,00X6] Fig.lliUusn.^ada^asemanngemen.sys.emforus.wimanlMserver.morder 
to collect and report data at the IM server, such data associated with IM users. 
,00171 Fig. ,2i..us^= S arepo rt onMactivi V andTVwa,chinghabi«s,ma t c 0 uldbe 
generated by the database management system of Fig. 1 1 . 

5 DETAILED DESCRIPTION OF THE INVENTION 

,00181 There are various configurations and embodiments implementing the present 

- v~«™4«T^a 1 where a communications network 
invention. One such implementation .s shown tnF.g. 1, where a 

,00 has a subscriber premises 1 10 connected by a network interface devtce (KID) 1 12 to a 
serviceprovidernetwotkUO. The NID 112 serves as demarcation point and interface 
20 hetweenatwistedpairdropcable 1 60 and tire twistedpair and outer wiring (and e^pmen > 
wittl in the subscriber premises. In the embodiment illustrated, .he subscnbe. ■ 
(Very high da.a rate Digital Subscriber Line) services from the seme* provtder, whereby the 
subscriber is provided interne, access a. apersonal computer 130, receives vtdeo 
programming (such as video-on-demand) and otirer information for display a. a .eleven 
25 132, and has telephone or voice service at one or more telephones 134. 

[0019, The network i„us«ra,ed is a fibet-te-me-neighborhood (FTTN) distribution system, 
L a central office 130 having optical fiber fines 154 (e.g., OC-3 .o OC-.2c) extendmg «o a 
universalsystemaecessmultiplexerfUSAM) 156, which in nun is connected <o fite 
subscriber NID 112 via tile twisted pair cnpper wire 160. The arrangement — 
30 dedicated VDSL loop between theUSAM 156 and me subscriber, using an extstrngPOTS 
telephone system twisted pair. A residential gateway or se. .op box (STB) 166 a. fire 
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♦ ™ nnint (electrical connections, encoding/decoding, 
subscriber premises provides a connection point (electrical 

1. ,v „nH the various customer devices (e.g., PC liu, iv 

multiplexing, etc.) between the network and the various 

mid telephone 134). While shown as separate components, the NID 112 and the 
132 and telephone J rfom all subscriber mterface functions within a smgle umt. 
166 could be combined to perform all suoscnocr u 

• fro m the US AM 1 56 connect to a high bandwidth, 
[0020, The fiber optic ^154^8 ftomJheUSAM ^ 

host digit* terming (HDT) 170 within the central office 150. The HOT 
d^aignalscontiuning ^^^^r^^eopaTCl.eU. 
eombines tirose as a broadband signa! to tire — J voice 

• i ♦ .far nublic switched telephone network (PS IN) iou, aire y 
s^ais .o/from tine pubh sw P ^ ^ ^ 

digital telephone swrtch 182 (2) v,deo s,gn 1 ^ _ ^ 

(3) ^ ,0/from tire interne, 190. *V«-* ^ ^ „ 

and the various systems, components and urterfacea P ^ 

avail ab,« and eatahhshed by various standards bodies, re.ecommumcaUons servrce provrd 
and manufacturers of VDSL equipment. 

[0021, Usmgmene^oAi.K.Coranyome.m^accessneh.ortc^dse^ce^ 

p^idera and their servers, and one such server - an insran, mesaagrng 0M 
0 hown in order to furmer IhusTraTe various embodiment of tire ^ 
server ,92 is of me W e operated by any one of many commercra, ~ 
providers, such as AOL®, Yahoo!® and MSN® (AOL rs a regrs,ered 
OnUne hrc, Duties, VA, Yahoo is a registered ^emaric of Yahoo! ^ * 
and MSN is a registered «rademari= of Microsoft Corporation, Retiman, WA), *rd wor* m 

inatan, messages among subscribers ma, have, for example, formed a buddy 
^(a-buddytist-isatisfor group of 

and tira, communica,e witir each otirer witiun ma, group via instant messagmg). 
,0.22, Before ieavingHg. ui,shon,dbeno t edmatmoneembodUnen,of*ehrvention, 
30 1 Jevision .32 a, me subscriber premises „0 witi be used ,o dispiay no, only v,d~ 
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(originating from headend 186), but also to display instant messaging oontent using 
applications, information and services provided by the EM server 192. 
(00231 Turning now to Fig. 2, mere is shown in greater detail the equipment within the 
subscriber premises 1 10 that may be used in implementing one embodiment of the present 
invention. In particular, there is shown the set top bo* (STB) 166, receiving broadband 
signals from a twisted pair line 212 coming from theNID 112 (Fig. 1). As mentioned earner, 
the signals passing through the NID (provided over the twisted pair drop cable or hue 160 
from the USAM 156 - see Fig. 1) contain voice, vide* and data originating from any one or 
all of the PSTN 180, interne. 190, and video headend system 186. The relevant functions 
within STB 166 will be described later, but briefly video, data and voice signals present m the 
broadband signals on tine 212 are separated Video (and companion audio) stgnals are 
usually received in an encoded format (e.g., MPEG-2) from the line 212, and are converted 
by the STB to an analog or other format suitable for a conventional televiston set and 
provided over line 214 to the TV 132. Voice signals are provided to telephone equmment 
over a telephone (bi-directional) line 216, and data signals are provided over a bi-directional 
line 218 to one or more personal computers. The STB 166 is powered by a suitable power 
source, such as household AC power. 

(0024] The TV 132 has a display screen (CRT, LCD, etc.), with the display operated to 
include a primary window 222 for displaying video programming content (origmatmg from 
the video headend 186), and a smaller, secondary window 224 for displaying mstant 
messaging screens. As will be described later, the STB 166 acts as a client (having its own 
processor and memory), running a java-capable or other suitable browser that is programmed 
to use an instant messaging application or applet downloaded from the IM server 192. Thus 
for instant messaging functions programmed into the STB processor, including sendmg, 
5 receiving and displaying instant messages and related content, the STB will commumcate 
with the IM server 192 to perform such instant messaging functions, and the mstant 
messaging screens used for such functions are displayed on the secondary window 224 and 
overlay the video programming on the primary window 222 of the TV 132. 
[0025] The size, shape and format of the windows 222 and 224 may change to suit the 
i0 preferences of the user. While Fig. 2 shows them as overlapping, it should be appreciated 
that for ease of viewing, the secondary window could have a vertical or horizontal shape on 
one side of the display screen, so that the primary window 222 can be resized when 
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secondary window 224 appears (in order for the video programming on the primary window 
to not be obstructed by the secondary window). 

l0 026] It should be noted that the PC 130 receiving data signals over line 218 may also 
have an instant messaging application applet downloaded from the same or a different IM 
server 192 However, such instant messaging functions and the corresponding screens are 
displayed at the PC 130 rather than the TV 132. The STB 166 may include a conventional 
router function that recognizes the TP addresses appended to messages received at the hne 
212 (and originating over the internet), and routes those messages to the client witfam the 
STB when they are addressed to the instant messaging application running within the STB, 
for ultimate display of instant messaging screens at the TV 132. Of course, IP addresses 
appended to messages intended for the PC 130 (whether as part of an instant messaging 
application or any other application on the PC) are routed by the STB to the PC over line 218. 
While not specifically illustrated, it should be appreciated that the STB as a client may also 
run applications other than instant messaging applications, and such applications or applets 
15 may also have information displayed at the TV 132. 

[00271 The STB 166 works with two user interface devices, a remote control 230 and a 
wireless keyboard 232. Both remote control 230 and wireless keyboard 232 may use 
conventional infrared techniques to communicate with the STB 166. The remote control 230 
may have conventional controls or buttons for controlling the operation of the TV 132 for 
20 viewing television programming. The keyboard 232 may likewise be a conventional device 
for controlling the client in the STB, in order to enter data and otherwise interact with any 
application controlling the secondary window 224 on the TV, which as mentioned earlier, 
may be used to display instant messaging content. While the remote control and keyboard 
are shown as separate devices herein, it will be appreciated that they could in fact be 
integrated into a single device for both controlling televisions programming and entering 
data. While not illustrated, other user interface devices (e.g., a mouse, roller ball, etc.) could 
also be used for controlling the STB 166. 

[0028] The internal features of the set top box 166 are illustrated in Figure 3. In this 
example the STB 166 is controlled by a central processing unit (CPU) 312, which is coupled 
to an Application-Specific Integrated Circuit (ASIC) 313. The CPU executes software 
designed to implement various functionality performed at the STB, in conjunction with the 
ASIC 313 and other components. The ASIC 313 also operates in conjunction with the CPU 



25 



30 



6 



10 



15 



3,2 to interconnect various components to the CPU artd operate the TV 132 well known 
m anner Connected to the ASIC are memory devices, soch as a ROM 3,4 (e.g., for stonng 
code used by the CPU), a RAM 316 (e.g., for storing digitized TV stgna,s so that they can be 
processed by the CPU 312 before viewing, in order ,o provide, among outer dungs, shared or 
spli, screen viewing,, IR interfaces 318 and 320 for the remote control 230 and wnetess 
Keyboard 232, respectively, and a VDSL interface 324 for receiving VSDL s.gna,s ftom me 
NIC 112 A mass storage device 330 may be used for storing data and apptications, and can 
be any suitable medium for storing machine executable instructions and data, such as 
magnetic disks, optica, disks, and the like. Also within the STB 166 are an audio dtgttal-to- 
analog converter (DAC) 328 which provides audio output to the TV 132, a video 
encoder/decoder 332 which provides video outpn. t» the TV 132, a telephone interface or 
modem 334 for passing voice signab to/torn the telephone 134, and a dam interface or 
modem 336 for passing data signals to/from the PC 130. As shou,d be appreciated, me 
tCephone interface 334 may have multip.e telephone ports, in order to accommodate mumple 
phone lines (each with a different phone number) within the subscriber premises, as well as 
the ability to connect severs, te.ephones to a sing,e port (for multiple telephones/extenstons 
sharing a single phone ,ine). Furthermore, the data interface 336 may have multiple data 
ports in order to permit connection of more than one PC 130 to the STB 166. 
[0029] The CPU 312 runs a java capable browser stored in the memory of the STB in order 
,0 download an instant messagmg application. The instant messaging application may be 
used by me subscriber to disp,ay instan, messages and related content torn other urstan. 
m essage subscribers, such content displayed in one embodiment on the secondary wtndow of 
TV 132 However, before displaying me content, it is necessary for each user to estebhsh a 
P rofi,e. Such profi.es are se, up in a well-known manner ,0 those familiar with instant 
5 messagmg,byen,eringper S onaldam(e.g..vfakeyhoard232)perteiningtomeuser^ 

However, in accordance with one embodiment of the present invention, certam profile dam 
established to enable users to communicate in a manner augmenting the conventional entry 
and display of date on an instant message screen. In particular users will enter telephone 
number information so that while communicating with other users on the subscrtber's 
,0 "buddy lis^ the user can initiate a telephone caU to discuss the content of then tnstant 
messages. This entry can be done in advance of posting the instant messages, e.g., when 
setting up a user profite a, the IM server 192. The manner of entering telephone information 
is illustrated in Fig. 4, where a profile screen is illustrated for setting up or joining an utstan, 
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messa*ng group ,^^.-^P— -*«- M,lto-f "" IM 
user. 

, apphcation). As can be seen, me screen inctades fieida - ^^^^7' 
illding a "User ID" fie,d 414 (the ID displayed with an instant message), M H» 
« 4,6 (the — tea! name of the user), "Location" field 418 (a city name or o^ 

. „u« -me foreoina fields are those commonly 
■Gender" field 424 and "Occupation" field 426. The forgomgn 

0 usedhypeopletoestablishthemselvesaauserswimmanMapplicanonandtnake 

miles vailable to be added to "buddy lists" set up by that user or others addrtiona, or 

Real Name "lames Smith", living in Denver, Colorado, and being a 22 year old, stngle, maie 
15 student. 

,0.3!, The information in the profiie (or portions of U) can be designated « ; "pubUc", mat 
revealed «o all other users in order for them to decide if they wan. the P rofi,ed user 

"file information (and other collected data - to be described) for commerce, purposes^ 

is made available only to (he user setting up (he profile, or 10 others (ha. tti 
,0032, fit one embodiment of me invention, me profifc screen 410 includes a Won. 
L " Ld 42S and a "Profile PubHc/Priva.e" field 430. The Telephone No. Md 428 
permus me user .o en.er and me IM server .o s.ore me persona, .eiephone number of *e 

olr users <o .dephone me profiied user during an instan. messaging sesston (as wrU be 

the user has designated his information as public). 
30 ,0033, I.shouldbeappreeia.edma.meSTB^maysmmandn^gemuMpJeprofiles 
so ma each househdd member a. me subscriber premises my separa,e,y use tit. M 
Ration with his/her own profile and preferences. A screen (no. shown) may be unban, 
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presented for each user to identify (using keyboard 232) hitnse.f and .hereby use his profile 
and preferences. The STB may also be programmed to default to one user if he/she is the 
principal user of the IM application. 

[0034] Fig. 5 illustrates a session set up screen 5 10 used by a user when setting up an 
mstan, message session with peop.e on his/her buddy Ust As illustrated, the user having tire 
ID "jsmith" has two buddy lists, "Lis. No. 1 and "Lis. No. 2". List No. 1 is illustrated as 
having four other users who are part of the Ust, and List No. 2 has two other users. Etther hst 
can be selected or clicked to permit "jsmith" to log on or join that instant messagrng or chat 
session (as seen in Fig. 5, Lis, No. 1 has three of its members logged "on" and one logged 
"OS" andListNo.2hadbotirofitsmemberslogged"off"). In addition to identifying each 
user, screen 510 displays tire TV program (if any) being currently viewed by that user. 
.0035. As also illustrated in Fig. 5, tire screen 510 has two fields for implementing certain 
embodiments of tire present invention. An "Accept Calls" field 516 permits tire user to ertirer 
accept telephone cans from other users on the selected buddy list, or no. accept those calls A 
"TV Show > field 518 permits the user to enter tire name of the TV show or program that he 
is watching while he is present in the IM session. In the embodiment shown in F.g. 2, the TV 
prngrammaybCheprogramdisplayedontireprunary window 222 of me TV 132, while 
screens from me instant messaging application are displayed on me secondary wmdow 224 of 
me TV 132. (While no. shown, screen 510 could be pre-programmed ,o lis. TV programs or 
channel so .ha. tire user may selec, me one being watched.) Various examples of ustng me 
TV programming identification will be described shortly in conjunction w«h F.g. 6. 
,0036] It should be mentioned that while the embodiments of tire invention described in 
connection with Fig 5 are illustrated wim the user entering me name of TV programing » 
field 518, alternatively such programming information could be captured electronically attire 
5 STB 166 Thatis.tireSTBieewillreceivepmgranmnnglDinfonnationalongwrmthe 
actual programming content, as part of tire standard MPEG-2 formatted signals from tire 
video headend 186 (Fig. 1), and if an IM application (implementing die present inventron) ts 
running at tire same time on tire CPU 312 within tire STB 166, such programmmg 
iden.ificationcanbeeap.uredands.oredau.omaticallybyti,elMapplicanon. Thts 

10 arrangement of course, permits the IM application to recognize a change in tire programmmg 
content or channel (such as a result of tire user changing TV channels) ttra. may occur dunng 
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fcaving .o return to screen 5 .0 and manually change the TV program ID or name. 

„ .„ Fie 6 there is illustrated a message display screen 610 that is 

; .ha screen illustrates messages from al, the users who are par. of Li t No. g 
aachofftoseusersseesftesamescreenforma.). The message display screen «0 wti> 
. «,;nHf»w 224 of TV 132. The message display screen has two 

0 ordertocomposemessagesbeforemeyaresentOiyselecnnga Send button ) 
ofterusers. As seen in Fig. 6, each message haa four components, namely an ID 

nan, 622 displaying die ID of die message sender, a "TV Show" component 624 

ZZ^^^^^^^'^T ma, 
" screen 5,0 in Fig. 5), a "Message Content" component 626 showmg die actual 

Kl ephone icon or button (graphical element) that can he selected . permit 

1 screen ,o telephone me sender of ft* message (assuming that die sender has dec ded to 

"is a, fil 5,6 in Fig. 5, As conventional, attachments audio, ^ he 
^edwiftamessagetmd.^oughno.mustiatedmH^.anatiaohmen.te.neanh. 

20 displayed with fte message to indicate the presence of die attachment. 

ha , , Send Video File button 640 fer sending a video file 

described later). 

■ . ^ .h»t the user of the IM appUcation implemented by the 
10039) Thu S ,i.canbeappr.c,atedma«fteuseroftti« PP ^ 

25 scre^ofFigS-^Sandeisuotonlyabletoseemessagesftomottieruserson 
r^a.soLwhichTVpro.rame.buseriswa.mng 

conversation (via email messages) concerning die TV program as par. of fte msUn. 
mlaging session. Furfter, fte user can selec. fte "Can" button a. any message „ , orda M» 
Zl a eiephone caU .o fte sender of fta. message so ft* among ofter 
30 Electing fte "Call" button and fte sender of fte message being caUeti, may a, o have a real 

subj ec.) a, fte same time as ftey are each viewing fte message display screen 610 m F,g. 6. 



10 



10 



15 



,0040, It should be further appreciated that other embodiments may use variations of*. 

JLh.K-4 5and6. As one example, ratber man a eha. session mvolvmg a group 
screens seen in ngs. ^,^ uu f . individual 

ofusets ftom a predefined buddy bst, a user may be messagmg oniy one 

se.ected for —eons display so ma, me user may still momtor ~ 
510 , even if sueh person is notpar, of an active instant messagmg sess.on (screen 610). 

l0 o4i, M»w.^^^^ aM *r~* 

Lied program steps (implemented within STB 1 66) for mtddng « * 
selecting me Call button 628 seen in Fig. 6. After me Call button has been selected * «p 
selectmgtne^ ctr ififi checks profile information of the selected 

710, the IM application runmng within STB 166 checks pron ..-tb^ 
.er (which has been downloaded by the IM Server 192 into memory wttiun th STB^to 
detennine (step 712) whether me person to he caned is accepting telephone calls (st* 
information was entered at field 516, screen 510 in Fig. 5, when thai person^ « 
session) if ft. person is not accepting calls, a message to mat effect (no, shown) - delayed 
HtV ,32,ats,ep7,4. If me person is accepting cal,, — "^J^Z, 
, 718 reads the telephone number stored with the profile informal within me STB memory 

„ Rg 4). The IM application men determines me correct diaUng forma, of th «.ephmte 
number to be called, step 720. This last mentioned step is necessary because me actual 
number to be dialed may have a forma, different man me forma, enlered a, screen 4,0. 
.5 i0042, This ,as, mentioned step 720 may involve one or more subprocesses, depending on 
LnLofmenumberstoredformepersonbelngcalled. For example a,, numbers are 
emereti in a ten digi, forma, as seen a, screen 4,0 (three digi, area codep.us seven dtgt, 
phone number). Two lookup ,ab,es within me STB can be used ,o detemune me proper 
dialing format needed to make die call. As an example, lets assume die person ^^^^^^ 

call The STB will bo programmed to convert me .elephone number stored (ten digfts to 
,ong distance call, retiring that a "1" precede the ten digi, number when dtaled, me STB 
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, • iHa the"!" in the dialed number, Thefollowing Table Illustrates 
proved to include the 1 m fh _ tQ convert ^ stor ed 

several different algorithms stored in STB 166 and tna 

• otplv formatted number for dialmg. 
telephone number into an appropriately formatted 

TABLE 1 



Algorithm 
Index 




0 
1 
2 
3 
4 



1 + 10D 
7D 
10D 
1 +7D 
5D 



"Dial out 1 followed by the last 10 digits 
Dial out the last 7 digits 
Dial out the last 10 digits 
Dial out 1 followed by the last 7 digits 
Dial out the last 5 digits 



l004il ^^^srr 

can also be stored in the STB 166 for determining which of the algon 
Table 1) should be used to dial the called number: 

TABLE 2 

Algorithm Index 




201 

202 

203 

204 

205 

206 

207 

208 

209 

210 

301 

302 

303 



0 

0 

0 

3 

2 

0 

0 

0 

0 

0 

0 

0 

1 
* 
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,0044, Thus, based on the area code of «he number ,0 be dialed, the STB 166 will use .he 
stored ten digit phone number, and reformat as necessary to comp.ete the call over the PSTN 
180. 

10045] Amorecomple.edescrip.ionofasys.emandapparan.sforproperiyforma.dnga 
dialed number from a stored telephone number (e.g., when the stored number is in a ten drgt. 
forma,) can be found in U.S. Paten, No. 6,597,785, entitled "Automatic CaUerK) Call Log 
Dial Back", issued to Burke «. al on July 22, 2003, which is hereby incorporated by reference. 
,0046, After the correct dialing number is determined, the STB 166 warts for a dial tone 
(step 722) a, me telephone connected » me STB and that tire user will use to make tire phone 
ca.l (most like* in close proximity to TV 132). For example, if mere are several phones 
(extensions) throughout me subscriber premises, and someone other titan me user ,s usrng one 
of me other telephones within tire premises, tire STB may be programmed .0 dtsplay a 
message a. me TV indicating that tire line is busy or tira, no dial .one is available. The STB 
can also tell me user through tire display that the number will be dialed when the phone .me 
becomes available (the user can decide whether to wait or cancel tire call mques,). 
,0047) After a dial tone is detected at step 722, tire user is intfructed (by display a. me TV), 
to pick up me telephone, step 724. Once the STB detects mat the telephone receiver has been 
picked up, the STB dials tire correctly formatted number (step 726), and when tire telephone 
receiver a. tire called .ocation is picked up, tire caU is completed (step 728) and tire _ * tire 
, dialing location and me user a. tire called location may men have a telephone conversanon 
(which in the illustrated embodiment is carried over the PSTN 180). 
■00481 » should be noted mat tire forgoing feature for calling a sender of an email message 
could be implemented in many otherways. For example, if .he central office switch 182 
(Fig 1) implements AIN (Advanced intelligent Network) functionality, the STB 166 could 
■5 dial the telephone number of me user to be called, and the switch 182 could call back me 
calling user as soon as mat call canbe completed. Further, tire telephone call could be made 
using IP telephony (using the internet), and the switch 182 could be bypassed altogether. 
[00491 Fig. 8 is a flow diagram illustrating the process flow and associated program steps 
by which me M user at the subscriber premises 1 10 may provide a video file to another M 
30 user Fig. 8 will be described in conjunction with Figs. 9 and 10, which illustrate functional 
features within STB 166 used in encrypting and decrypting video files and keys as part of tire 
process of Fig. 8. In Fig. 8, the user firs, selects (step 810) me Send Video File bu..on 640 
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seen in Fig. 6. In one embodiment, the user may merely select (step 812) 
^havepreviouslybeenstoredbymelMuserwithinthememoryofmeSTB 166. Such 

fi.es are stored in an appropriate format, such as MPEG-2. However, the user may also select 
a file ,o be created or ma, is currently being created, such as a file or video chp of the 
pro-am ma, *= user is currently watening a, TV 132. Systems and fo ~ 

a registered trademark of TiVo, Inc., Alviso, CA). Such a system is descnbed m .S. Paten 
No 6 233 389, entitled Multimedia Time Warping System, issued to Barton e« al. on May 15, 
2002 'which is hereby incorporated by reference. If such a system were employed, TV 
0 propammingcurtentiybeingvieweda.TV .32 is simultaneous being stored m memory 
and me user sending the attachment could identify a TV show or portion thereof ma, m,gh. 
appeal to another user as he o, she is watching if, and use me stored file of me TV program as 
an attachment ,o an insfan, message created as me TV program is still being washed. 

.0050] It should be appreciated mat depending on the source, the video file to be shared 
a maybesmredinaproprie,aryfonnat(e.g.,omermanMPEG.2)a.meSTB16^For 

example, if the file is created using the previously mentioned TiVo system, such file would 
be in a TiVo proprietary forma, and may be stored a, the STB in mat proprietary fomrat The 
fil e may be re-formatted (to MPEO-2) by the STB when shared with others, or shared (sen, to 
another IM user) in me stored proprietary fonna, if me destination STB is progrcmmed «o use 
20 that proprietary format. 

,00511 After the user has selected a video file, me STB may also attach (step 814) an 
encryption key associated with that TV program file. This is particularly useful if the TV 
program is broadcast on a premium channel (the user has paid a subscription fee for vrewmg 
a, TV 132), and me program has been encrypled using well know encryption techmques to 
25 prevent unauthorized viewing. 

.0052] In order «o more completely unders«and mis las, mentioned feamre of the described 
embodiment (implemented a, step 814), reference can be made ,0 Fig. 9. which illusttates me 
use of encryption for TV programming as couldbe implemented by me CPU 312 and other 
toctionaUtywiminSTB 166. As can be seen, the encryption/decryption functionahty wttmn 
30 the STB 166 includes a decryption function 912 for receiving an encrypted program or 

service, and providing the program in a decrypted forma, at its output, through me use of a 
working key provided by a security processor 914. The securi.y processor 914 is connected 
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,0 memory (RAM 918 and ROM 920). The memory — bo* an l^T*- 
provided by fire service provider when ft. nser snbscribes rc the servrce, and a monflfi key 
L is proled by the service provider (changed each .on* ro make i. difficui, to obram 
Authorized access to the program). As illustrated in Fig. 10, the STB 166 uses the pie-key 
to decrypr (block 1010) the monthly key, resulting in a working key that ,s provrderi to fir 
programming decryption function 912 (Fig. 9) in order to decrypt the programing stgna,. 

fce video enccoer/decoder 332 (previously discussed in conjunct wrdr F.g. 3). ff* n- 
, is not authorized, the switch 926 provides encrypted programming (scrambled so as to no, 
viewable) to TV 132. 

,0053, The encryption/decryption techniques described axe well known, and techniques 
otherthan those described comdbe employed. A more detailed description of the 

5 on January 14, 1997, which is hereby incorporated by reference. 

,0054, As seen in Fig. 9, the video provided to TV 132 is also outputter, as a ffle (MPEG-2 
format) to be stored within the STB 166. Such rile can be accessed and men aen, to another 
user as an video file anached to an instan, message (step 8,2, Fig. 8). Further as afco seen tn 
Fig 9, me security processor 9H afco supplies the working key so that it cm, be stored wrth 
20 the video file, for reasons to be explained shortly. 

,0055, RenrrningtoFig.S.melMuserwan.ing.oanachavideofilemensendstte 
Lie with the se,ec.ed video file (which is now decrypt* bu, includes the workmg ke 
sssocld with that video file), step 8 !6. When the message and attachmen , ^are recerved * 
»em,endeodeaonarion(U.,oneoffireother users onme ^uddy Us,) *e STB 166 
25 desfinafion stores me video file, and compares fire working key (sen, wnh «he mesaage) to 
working key general a, ma, STB, step 818. In particuUr, if «h= desfinanon uaer has 
subscribe., to fire same premium channel, ma, STB a, me destination takes the program pre- 
key and month* key atored a, ma, looation for viewing encrypted programing, and denves 
a Irking key (see Fig. ,0). and compares tha, working key ,0 Ore workmg key sen, wrth the 
30 videofde. It should be noted that the destination user may subscribe to more than one 
premium channel or pay-per-view channel, i, which case a comparison is made of the 
working key generated for each such channel to fire working key sen, wrth fire adachment. 
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M ,ep 820, if a match is made, the video file is passed to the TV connected to the STB a, 



displayed. 



s out one example of a process for assuring that the destination user authored to view Ore 
^n,. ^Lsdratdredestinaaondec^anronU.v^ro^a^ev 

assurestnat k , mmts the video file could be sent with just the program pre- 

However in alternative embodunents, tne vmeo uio ^ 

10 be present (or can be generated, a, a destination when that destination ,s an authored 
viewer/location of me channel torn which me video file was originally made. 
,0057, Itshouldbeapprecia^matmememoddescnbedaboveforma^hing.reys,^ 

vW eo or other protected file dirtribute, each message to a group of user, e^) who 
1 5 happen to be on me "buddy lis.", and thus where it is difficult or impractical for me user 

per-view) channe,, and be ab.e to verify ma, each such recipient is in fact so authorized. 
[0058, Turnmgnow.oFig^.nandn.mereismus^anarrangementwh^erethe 
luuaoj 6 , -njr _ prve ,\ maY use data collected 

90 durine an IM session. In particular, there is seen in Fig. 1 1 a survey aa 

oTeMLr.92. ThedatabaselllOstoreadaUcoUectedorgleanerifiommemesaages 

TV programs those users are watching (based on the TV programming «— 
25 preLd with instan, messages), key words present in messages, and so form. The debase 
U 10 is connect* to a database or survey system 1 1 U, that include, a survey server 11 14 

other action, in connection wim me data, building database report,, etc.. and a printer 1118 
for printing database reports, etc. 
30 [0059, Thetypesofdatamatarecollectedandmereporumatcanbegenemtedbyute 
rLcysteTnnarenumerous. [, ,hou,d be appreciated ma, smce me darted 
rel a,e, ,0 instant messaging being ported, TV programs being warded by «he U user,. 
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telephone calls being made in association with the messages, and other data associated with 
the content of those messages, that the data is real time, i.e., reflects instantaneous activity by 
users. As an example, if a TV programming entity wants to know on an instantaneous basis 
how audiences are reacting to a broadcast program, the data generated at system 1 1 12 can be 
5 used by the survey system operator for such purpose. 

[0060] An exemplary report in such an instance is shown in Fig. 12, where at a given time 
(8: 15PM) for a given broadcast program ("TV Show A"), a programming entity can learn 
how many users are using the IM server 192 (the total survey population), how many of those 
users are watching Show A, whether over a period of time (say, 5 minutes) the number of 
10 viewers is trending up or down (i.e., whether the number of viewers has increased or 

decreased), and how the TV program is impacting instant mail activity and phone activity (an 
increase in mail or phone activity by users watching Show A might indicate the degree of 
interest in the program). In addition, to the extent users have permitted profile data to be 
used (field 430 in Fig. 4), the survey organization may also learn about the demographics of 
15 the users being reported. All of this is real time, of course, with data changing as activity 
changes, and such instantaneous data capable of being reported as it changes. This permits 
the survey organization, for example, to note favorable or unfavorable instant messaging 
activity moment by moment, or scene by scene, as a TV program progresses. 
[0061] In conclusion, the described embodiments of the invention provide networks, 
20 systems and methods implementing various applications, features, and functionality relating 
to instant messaging and similar services. While the network 100 is described as employing 
VDSL service, it should be appreciated that other forms of data transmission could be 
employed. For example, the video programming or signals transmitted to the STB 166 at the 
subscriber premises (and even the voice and data signals) can be from one or more video 
25 sources, such as cable TV, satellite, and other forms of wireline and wireless transmission. 
Such transmission can be made in conjunction with or separately from the 
connections/transmissions between the subscriber premises and the central office 150. In 
such example, if video programming originates from a satellite system, then the NID 1 12 (in 
Fig. 1) may receive signals (e.g., voice and data) over drop cable 160 and the STB 166 may 
30 also separately receive video programming from a separate line (not shown) carrying video 
signals from a satellite dish at the subscriber premises. 
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,0062, Furthermore, in other events, the mnctionalrtv descnbed as resufcn, ft. 
STB 166 (e g look up tables for telephone calling, assembling attachments and the 

or in whole at the IM server 12 rather than the STB 166. 

,0063, While a detailed deseription of presently preferred embodiments °^ — . 

L een given above, va^ous alternatives, mediations, and eqtrivalentswill e apparent 

.moses^edmmeartwimoutvaryingnommespHtofmeinvenaon 

above descriptionshouldnotbe taken as Umimrgthe scope ofthe inventron, whroh „ define* 

by the appended claims. 
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